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Spaceport Innovators wr 


¢ Begun in 2012 
¢ Created KSC Innovation Expo 
¢ Annual event designed to 
showcase innovative work 
being done at KSC 
¢ KSC Kickstart Competition 
¢ 90 second elevator speech to 
panel of judges 
¢ Winners receive up to $5000 
to develop their ideas 
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Virtual Control Panel 


¢ Goals 


¢ Tools 
¢ Microsoft Kinect 
¢ Sony HMZ-T1 
¢ Lego Mindstorm 
¢ Custom desktop 


7 ¢ Interact with a virtual 
: environment 

r ¢ Use interactions to 

: affect the state of 

2 physical objects in the 
é “real” world 

z 
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Virtual Control Panel wr 


Results 
¢ HMD issues 
¢ Kinect 
¢ Weaknesses 
¢ Joint occlusion 
¢ Bone length 
¢ Jitter 
¢ Lack of fidelity (too few points) 
¢ Mindstorm 
¢ Unreliable response to Bluetooth 
signals 


Fixes 

¢ Replace HMZ-T1 with Oculus Rift DK2 

¢ Introduce multiple Kinects, dedicated 
processors 
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Phase 1: — tw 


Single 
process 
or, single 
Kinect 


Virtual Control Panel 


map... Bag wanted 


ee 
Phase 2: — 
Single 
processor, 
multiple 
Kinects 


Phase 3: Multiple 
processors 
networked 
together, 
multiple Kinects 
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Problem: 


Resolving multiple Kinect data 
streams of “skeleton” points into 
one reliable skeleton is 
mathematically, and therefore 
computationally, intensive, which 
adds latency. 


The requirement for a distributed 
system using multiple processors 
and networking increases the 
complexity of the system while 
reducing the latency problem. 


Virtual Control Panel (cont’d.) 


Note that, in the computation of each frame, the optimized 
joint-positions obtained in previous frames are used as the 
initial value of X. Using the sequential linearly constrained 
programming, the second derivatives of the constraint are ne- 
glected. The equation VJ?(X)d = —VJ(X) to be solved in 
each step is simplified to 


HA Vig, » Tb, 
(xo 2) @ 
with [pj }new = {py} +d . Here, the vectors A and bp are 


d 


A = {=== 
op; i 


>) dlp; = pjll= 8,97} (4) 
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and the value of , is 


by =— >) (lpi - pill- 49". 6) 


i fheSa 


H is a diagonal matrix H = diag{h,} that has 


2 
ha = soot, pill-+ lip ~ qi +01). 0) 
t 
Efficient Numerical Scheme: By the above formulation, 
when applying the iterations to find optimal value of {p;}, we 
can actually determine the value of d, in a more direct way 
(.e., without applying the general numerical solver). Specif- 
ically, the value of A can be computed by 


A= (Ab, — ba) (AHA) (8) 
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° Same technology as the wits ee i oe 
Kinect, but is specific og an ‘ 
to the hands and Kinect V.1 sa Oi 
fingers Kinect V.2 


¢ More interested in 
location, orientation of 
hands and fingers than 
with the whole body 
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S Virtual Tablet 


Goals 

¢ Integrate VR and motion 
capture technologies 

¢ Introduce haptic 
feedback to the virtual 
environment without 
using feedback devices 


Tools 

¢ Leap Motion 

¢ Optitrack Motion 
Capture system 

¢ Unity3D 
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Orion Virtual Cockpit 


el 


NASA’s Space Launch System, 
under development now, is 
currently scheduled to launch 
once to twice per year. 
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Goals 


¢ Trainer 
¢ Keep technical 
personnel skills up to 
speed 


¢ Troubleshooting Platform 
¢ Evaluate problems, 
develop fixes without 
requiring a physical CM 


¢ Testbed 


Immersive Virtual Telepresence wr 


Goals Te. ve 

- Build a full 360° _ 
virtual 
environment 
using 360Fly 
cameras 


Tools 
¢ 360Fly cameras 
¢ HTC Vive 
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Holographic Rovers Wr. 


Goals 

¢ Evaluate the Microsoft 
Hololens as a potential tool 
for engineering, training, 
collaboration 


Result 
¢ Holographic 
Rovers 
¢ Intern project 

to work with 
device, learn 
its strengths, 
weaknesses 
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Next Steps 


Natural User Interface 

¢ Computer Vision 

¢ Speech Recognition 
and Synthesis 

¢ Artificial Intelligence 
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Conclusions 


¢ AR/VR technology is the next wave of the 
computer revolution 
¢ Traditional forms of HCI are on their 
way out 


HOWEVER 


¢ The current maturity level of the tools in 
use is still too low to allow them to be used 
in operational scenarios as envisioned 
here 
¢ That will change rapidly 


